Integrated navigation and visualisation for skull base surgery

Skull base surgery involves the management of tumours located on the underside of the brain and the base of the skull. Skull base tumours are intricately associated with several critical neurovascular structures making surgery challenging and high risk. Vestibular schwannoma (VS) is a benign nerve sheath tumour arising from one of the vestibular nerves and is the commonest pathology encountered in skull base surgery. The goal of modern VS surgery is maximal tumour removal whilst preserving neurological function and maintaining quality of life but despite advanced neurosurgical techniques, facial nerve paralysis remains a potentially devastating complication of this surgery. This thesis describes the development and integration of various advanced navigation and visualisation techniques to increase the precision and accuracy of skull base surgery. A novel Diffusion Magnetic Resonance Imaging (dMRI) acquisition and processing protocol for imaging the facial nerve in patients with VS was developed to improve delineation of facial nerve preoperatively. An automated Artificial Intelligence (AI)-based framework was developed to segment VS from MRI scans. A user-friendly navigation system capable of integrating dMRI and tractography of the facial nerve, 3D tumour segmentation and intraoperative 3D ultrasound was developed and validated using an anatomically-realistic acoustic phantom model of a head including the skull, brain and VS. The optical properties of five types of human brain tumour (meningioma, pituitary adenoma, schwannoma, low- and high-grade glioma) and nine different types of healthy brain tissue were examined across a wavelength spectrum of 400 nm to 800 nm in order to inform the development of an Intraoperative Hypserpectral Imaging (iHSI) system. Finally, functional and technical requirements of an iHSI were established and a prototype system was developed and tested in a first-in-patient study

Imaging biomarkers associated with extra-axial intracranial tumors: a systematic review

Extra-axial brain tumors are extra-cerebral tumors and are usually benign. The choice of treatment for extra-axial tumors is often dependent on the growth of the tumor, and imaging plays a significant role in monitoring growth and clinical decision-making. This motivates the investigation of imaging biomarkers for these tumors that may be incorporated into clinical workflows to inform treatment decisions. The databases from Pubmed, Web of Science, Embase, and Medline were searched from 1 January 2000 to 7 March 2022, to systematically identify relevant publications in this area. All studies that used an imaging tool and found an association with a growth-related factor, including molecular markers, grade, survival, growth/progression, recurrence, and treatment outcomes, were included in this review. We included 42 studies, comprising 22 studies (50%) of patients with meningioma; 17 studies (38.6%) of patients with pituitary tumors; three studies (6.8%) of patients with vestibular schwannomas; and two studies (4.5%) of patients with solitary fibrous tumors. The included studies were explicitly and narratively analyzed according to tumor type and imaging tool. The risk of bias and concerns regarding applicability were assessed using QUADAS-2. Most studies (41/44) used statistics-based analysis methods, and a small number of studies (3/44) used machine learning. Our review highlights an opportunity for future work to focus on machine learning-based deep feature identification as biomarkers, combining various feature classes such as size, shape, and intensity.Systematic Review Registration: PROSPERO, CRD4202230692

A Clinical Guideline Driven Automated Linear Feature Extraction for Vestibular Schwannoma

Vestibular Schwannoma is a benign brain tumour that grows from one of the balance nerves. Patients may be treated by surgery, radiosurgery or with a conservative "wait-and-scan" strategy. Clinicians typically use manually extracted linear measurements to aid clinical decision making. This work aims to automate and improve this process by using deep learning based segmentation to extract relevant clinical features through computational algorithms. To the best of our knowledge, our study is the first to propose an automated approach to replicate local clinical guidelines. Our deep learning based segmentation provided Dice-scores of 0.8124 +- 0.2343 and 0.8969 +- 0.0521 for extrameatal and whole tumour regions respectively for T2 weighted MRI, whereas 0.8222 +- 0.2108 and 0.9049 +- 0.0646 were obtained for T1 weighted MRI. We propose a novel algorithm to choose and extract the most appropriate maximum linear measurement from the segmented regions based on the size of the extrameatal portion of the tumour. Using this tool, clinicians will be provided with a visual guide and related metrics relating to tumour progression that will function as a clinical decision aid. In this study, we utilize 187 scans obtained from 50 patients referred to a tertiary specialist neurosurgical service in the United Kingdom. The measurements extracted manually by an expert neuroradiologist indicated a significant correlation with the automated measurements (p < 0.0001).Comment: SPIE Medical Imagin

Spatial gradient consistency for unsupervised learning of hyperspectral demosaicking: Application to surgical imaging

Hyperspectral imaging has the potential to improve intraoperative decision making if tissue characterisation is performed in real-time and with high-resolution. Hyperspectral snapshot mosaic sensors offer a promising approach due to their fast acquisition speed and compact size. However, a demosaicking algorithm is required to fully recover the spatial and spectral information of the snapshot images. Most state-of-the-art demosaicking algorithms require ground-truth training data with paired snapshot and high-resolution hyperspectral images, but such imagery pairs with the exact same scene are physically impossible to acquire in intraoperative settings. In this work, we present a fully unsupervised hyperspectral image demosaicking algorithm which only requires exemplar snapshot images for training purposes. We regard hyperspectral demosaicking as an ill-posed linear inverse problem which we solve using a deep neural network. We take advantage of the spectral correlation occurring in natural scenes to design a novel inter spectral band regularisation term based on spatial gradient consistency. By combining our proposed term with standard regularisation techniques and exploiting a standard data fidelity term, we obtain an unsupervised loss function for training deep neural networks, which allows us to achieve real-time hyperspectral image demosaicking. Quantitative results on hyperspetral image datasets show that our unsupervised demosaicking approach can achieve similar performance to its supervised counter-part, and significantly outperform linear demosaicking. A qualitative user study on real snapshot hyperspectral surgical images confirms the results from the quantitative analysis. Our results suggest that the proposed unsupervised algorithm can achieve promising hyperspectral demosaicking in real-time thus advancing the suitability of the modality for intraoperative use

Artificial intelligence and medical education: a global mixed-methods study of medical students’ perspectives

Objective: Medical students, as clinicians and healthcare leaders of the future, are key stakeholders in the clinical roll-out of artificial intelligence-driven technologies. The authors aim to provide the first report on the state of artificial intelligence in medical education globally by exploring the perspectives of medical students. Methods: The authors carried out a mixed-methods study of focus groups and surveys with 128 medical students from 48 countries. The study explored knowledge around artificial intelligence as well as what students wished to learn about artificial intelligence and how they wished to learn this. A combined qualitative and quantitative analysis was used. Results: Support for incorporating teaching on artificial intelligence into core curricula was ubiquitous across the globe, but few students had received teaching on artificial intelligence. Students showed knowledge on the applications of artificial intelligence in clinical medicine as well as on artificial intelligence ethics. They were interested in learning about clinical applications, algorithm development, coding and algorithm appraisal. Hackathon-style projects and multidisciplinary education involving computer science students were suggested for incorporation into the curriculum. Conclusions: Medical students from all countries should be provided teaching on artificial intelligence as part of their curriculum to develop skills and knowledge around artificial intelligence to ensure a patient-centred digital future in medicine. This teaching should focus on the applications of artificial intelligence in clinical medicine. Students should also be given the opportunity to be involved in algorithm development. Students in low- and middle-income countries require the foundational technology as well as robust teaching on artificial intelligence to ensure that they can drive innovation in their healthcare settings

Clinical Applications for Diffusion MRI and Tractography of Cranial Nerves Within the Posterior Fossa: A Systematic Review

Objective: This paper presents a systematic review of diffusion MRI (dMRI) and tractography of cranial nerves within the posterior fossa. We assess the effectiveness of the diffusion imaging methods used and examine their clinical applications.Methods: The Pubmed, Web of Science and EMBASE databases were searched from January 1st 1997 to December 11th 2017 to identify relevant publications. Any study reporting the use of diffusion imaging and/or tractography in patients with confirmed cranial nerve pathology was eligible for selection. Study quality was assessed using the Methodological Index for Non-Randomized Studies (MINORS) tool.Results: We included 41 studies comprising 16 studies of patients with trigeminal neuralgia (TN), 22 studies of patients with a posterior fossa tumor and three studies of patients with other pathologies. Most acquisition protocols used single-shot echo planar imaging (88%) with a single b-value of 1,000 s/mm2 (78%) but there was significant variation in the number of gradient directions, in-plane resolution, and slice thickness between studies. dMRI of the trigeminal nerve generated interpretable data in all cases. Analysis of diffusivity measurements found significantly lower fractional anisotropy (FA) values within the root entry zone of nerves affected by TN and FA values were significantly lower in patients with multiple sclerosis. Diffusivity values within the trigeminal nerve correlate with the effectiveness of surgical treatment and there is some evidence that pre-operative measurements may be predictive of treatment outcome. Fiber tractography was performed in 30 studies (73%). Most studies evaluating fiber tractography involved patients with a vestibular schwannoma (82%) and focused on generating tractography of the facial nerve to assist with surgical planning. Deterministic tractography using diffusion tensor imaging was performed in 93% of cases but the reported success rate and accuracy of generating fiber tracts from the acquired diffusion data varied considerably.Conclusions: dMRI has the potential to inform our understanding of the microstructural changes that occur within the cranial nerves in various pathologies. Cranial nerve tractography is a promising technique but new avenues of using dMRI should be explored to optimize and improve its reliability

Deep Reinforcement Learning Based System for Intraoperative Hyperspectral Video Autofocusing

Hyperspectral imaging (HSI) captures a greater level of spectral detail than traditional optical imaging, making it a potentially valuable intraoperative tool when precise tissue differentiation is essential. Hardware limitations of current optical systems used for handheld real-time video HSI result in a limited focal depth, thereby posing usability issues for integration of the technology into the operating room. This work integrates a focus-tunable liquid lens into a video HSI exoscope, and proposes novel video autofocusing methods based on deep reinforcement learning. A first-of-its-kind robotic focal-time scan was performed to create a realistic and reproducible testing dataset. We benchmarked our proposed autofocus algorithm against traditional policies, and found our novel approach to perform significantly ($p<0.05$) better than traditional techniques ($0.070\pm.098$ mean absolute focal error compared to $0.146\pm.148$). In addition, we performed a blinded usability trial by having two neurosurgeons compare the system with different autofocus policies, and found our novel approach to be the most favourable, making our system a desirable addition for intraoperative HSI.Comment: To be presented at MICCAI 202

Lightfield hyperspectral imaging in neuro-oncology surgery: an IDEAL 0 and 1 study

IntroductionHyperspectral imaging (HSI) has shown promise in the field of intra-operative imaging and tissue differentiation as it carries the capability to provide real-time information invisible to the naked eye whilst remaining label free. Previous iterations of intra-operative HSI systems have shown limitations, either due to carrying a large footprint limiting ease of use within the confines of a neurosurgical theater environment, having a slow image acquisition time, or by compromising spatial/spectral resolution in favor of improvements to the surgical workflow. Lightfield hyperspectral imaging is a novel technique that has the potential to facilitate video rate image acquisition whilst maintaining a high spectral resolution. Our pre-clinical and first-in-human studies (IDEAL 0 and 1, respectively) demonstrate the necessary steps leading to the first in-vivo use of a real-time lightfield hyperspectral system in neuro-oncology surgery.MethodsA lightfield hyperspectral camera (Cubert Ultris ×50) was integrated in a bespoke imaging system setup so that it could be safely adopted into the open neurosurgical workflow whilst maintaining sterility. Our system allowed the surgeon to capture in-vivo hyperspectral data (155 bands, 350–1,000 nm) at 1.5 Hz. Following successful implementation in a pre-clinical setup (IDEAL 0), our system was evaluated during brain tumor surgery in a single patient to remove a posterior fossa meningioma (IDEAL 1). Feedback from the theater team was analyzed and incorporated in a follow-up design aimed at implementing an IDEAL 2a study.ResultsFocusing on our IDEAL 1 study results, hyperspectral information was acquired from the cerebellum and associated meningioma with minimal disruption to the neurosurgical workflow. To the best of our knowledge, this is the first demonstration of HSI acquisition with 100+ spectral bands at a frame rate over 1Hz in surgery.DiscussionThis work demonstrated that a lightfield hyperspectral imaging system not only meets the design criteria and specifications outlined in an IDEAL-0 (pre-clinical) study, but also that it can translate into clinical practice as illustrated by a successful first in human study (IDEAL 1). This opens doors for further development and optimisation, given the increasing evidence that hyperspectral imaging can provide live, wide-field, and label-free intra-operative imaging and tissue differentiation